Web Survey Bibliography
This article investigates estimation of finite population totals in the presence of univariate or multivariate auxiliary information. Estimation is equivalent to attaching weights to the survey data. We focus attention on the several weighting systems that can be associated with a given amount of auxiliary information and derive a weighting system with the aid of a distance measure and a set of calibration equations. We briefly mention an application to the case in which the information consists of known marginal counts in a two- or multi-way table, known as generalized raking. The general regression estimator (GREG) was conceived with multivariate auxiliary information in mind. Ordinarily, this estimator is justified by a regression relationship between the study variable y and the auxiliary vector x. But we note that the GREG can be derived by a different route by focusing instead on the weights. The ordinary sampling weights of the kth observation is 1/π<sub>k</sub>, where π<sub>k</sub> is the inclusion probability of k. We show that the weights implied by the GREG are as close as possible, according to a given distance measure, to the 1/π<sub>k</sub> while respecting side conditions called calibration equations. These state that the sample sum of the weighted auxiliary variable values must equal the known population total for that auxiliary variable. That is, the calibrated weights must give perfect estimates when applied to each auxiliary variables and the study variable means that the weights that perform well for the auxiliary variable also should perform well for the study variable. The GREG uses the auxiliary information efficiently, so the estimates are precise; however, the individual weights are not always without reproach. For example, negative weights can occur, and in some applications this does not make sense. It is natural to seek the root of the dissatisfaction in the underlying distance measure. Consequently, we allow alternative distance measures that satisfy only a set of minimal requirements. Each distance measure leads, via the calibration equations, to a specific weighting system and thereby to a new estimator. These estimators form a family of calibration estimators. We show that the GREG is a first approximation to all other members of the family; all are asymptotically equivalent to the GREG, and the variance estimator already known for the GREG is recommended for use in any other member of the family. Numerical features of the weights and ease of computation become more than anything else the bases for choosing between the estimators. The reasoning is applied to calibration on known marginals of a two-way frequency table. Our family of distance measures leads in this case to a family of generalized raking procedures, of which classical raking ratio is one.
Homepage (Abstract)
Web survey bibliography - Measurement (1822)
- Calibration as a standard method for treatment of nonresponse; 1999; Lundstrom, S., Sarndal, C.-E.
- Question Appraisal System - QAS-99 ; 1999; Willis, G. B., Lessler, J. T.
- Current Internet science - trends, techniques, results. ; 1999; Reips, U.-D., Batinic, B., Bandilla, W., Bosnjak, M., Graef, L., Moser, K., Werner, A.
- Exploring Data Collection by the Internet ; 1998; Wings, H., Snijkers, G.
- The political relevance of political trust; 1998; Hetherington, M. J.
- Human centered measures of success in web site design; 1998; Kirakowski, J., Claridge, N., Whitehand, R.
- Formal features of rating scales and their interpretation of question meaning; 1998; Schwarz, N., Grayson, C. E., Knauper, B.
- Collecting sensitive information with different modes of data collection; 1998; Couper, M. P., Tourangeau, R., Smith, T. W.
- Comparing the response rate, response speed and response quality of two methods of sending questionnaires...; 1998; Tse, A. C. B.
- Internet marketing research: resources and techniques; 1997; Forrest, E.
- Feeling thermometers versus 7-point scales. Which are better?; 1997; Alwin, D. F.
- Electronic methods of collecting survey data: A review of E-research; 1997; Tuten, T. L.
- Editing of survey data: How much is enough?; 1997; Grandquist, L., Kovar, J. G.
- Designing rating scales for effective measurernent in surveys; 1997; Krosnick, J. A., Fabrigar, L. R.
- Mail Surveys for Election Forecasting? An Evaluation of the Columbus Dispatch Poll; 1996; Krosnick, J. A.
- The VSB-Center savings project: Data collection methods, questionnaires and sampling procedures; 1996; Nyhus, E. K.
- The how and why of response latency measurement in telephone interviews; 1996; Bassili, J. N.
- The Direction of context effects. What determines assimilation or contrast in attitude measurement?; 1996; Sudman, S., Bradburn, N. M., Schwarz, N.
- SUS - A quick and dirty usability scale; 1996; Brooke, J.
- Response latency as a signal to question problems in survey research; 1996; Bassili, J. N., Scott, S. B.
- Psychological sources of context effects in survey measurement; 1996; Sudman, S., Bradburn, N. M., Schwarz, N.
- Cognition and communication: Judgmental biases, research methods, and the logic of conversation; 1996; Schwarz, N.
- Addressing disturbing and disturbed consumer behavior: Is it necessary to change the way we conduct...; 1996; Petty, R. E., Cacioppo, J. T.
- CGI scripts: Gateways to World-Wide Web power; 1996; Kieley, J. M.
- The effect of computer-assisted interviewing on data quality: A review.; 1995; de Leeuw, E. D., Hox, J., Snijkers, G.
- Subsequent questions may influence answers to preceding questions in mail surveys; 1995; Schwarz, N., Hippler, H. J.
- How to conduct self-administered and mail surveys; 1995; Bourque, L. B., Fielder, E. P.
- Alternative methods of presenting bi-polar scales in telephone interviews: 1 to 7 vs. -3 to +3 and neutral...; 1995; Schaeffer, N. C., Baker, K.
- The effects of alternative methods of collecting similarity data for multidimensional scaling; 1995; Bijmolt, T. H. A., Wedel, M.
- The numeric values of rating scales: A comparison of their impact in mail surveys and telephone interviews...; 1994; Schwarz, N., Hippler, H. J.
- Decentralised CATI Versus Paper and Pencil Interviewing: Effects on the Results in the Swedish Labour...; 1994; Bergman, L. R., Kristiansson, K.-E., Olofsson, A., Safstrom, M.
- The biasing effect of scale-checking styles on response to a Likert scale; 1993; Friedman, H., Herskovitz, P. J., Pollack, S.
- SUMI: the Software Usability Measurement Inventory; 1993; Kirakowski, J., Corbett, M.
- Generalized raking procedures in survey sampling; 1993; Deville, J. C., Sarndal, C. E., Sautory, O.
- Discovery-oriented consumer research; 1993; Wells, W. D.
- Serial context effects in survey interviews; 1992; Daamen, D. D. L., de Bie, S.
- Report on feeling thermometer for "moderates"; 1992; Brady, H. E.
- Context effects: State of the past/State of the art; 1992; Schuman, H.
- Calibration estimators in survey sampling; 1992; Deville, J. C., Sarndal, C.-E.
- Best pracices in disk-by-mail surveys; 1992; Witt, K. J., Bernstein, S.
- Data Quality in Mail, Telephone and Face to Face Surveys; 1992; De Leeuw, E. D.
- Response-Order Effects in Likert-Type Scales; 1991; Chan, J. C.
- Mode effects of cognitively designed recall questions: A comparison of answers to telephone and mail...; 1991; Dillman, D. A., Tarnai, J.
- Towards a response model in establishment surveys; 1991; Edwards, W. S., Cantor, D.
- The design and analysis of reinterview: An overview; 1991; Forsman, G., Schreiner, I.
- Response-time measurement in survey research. A method for CATI and a new look at nonattitudes; 1991; Bassili, J. N., Fletcher, J. F.
- Culture and the self: Implications for cognition, emotion, and motivation; 1991; Markus, H. R., Kitayama, S.
- Response strategies for coping with the cognitive demands of attitude measures in surveys; 1991; Krosnick, J. A.
- Dimensional analysis of ranking data; 1990; Brady, H. E.
- A study of procedures to identify and trim extreme sampling weights; 1990; Potter, F.